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Abstract 

A model for decision making that generalizes Expected Utility Max- 
imization is presented. This model, Expected Qualitative Utility Maxi- 
mization, encompasses the Maximin criterion. It relaxes both the Inde- 
pendence and the Continuity postulates. Its main ingredient is the defini- 
tion of a qualitative order on nonstandard models of the real numbers and 
the consideration of nonstandard utilities. Expected Qualitative Utility 
Maximization is characterized by an original weakening of von Neumann- 
Morgenstern's postulates. Subjective probabilities may be defined from 
those weakened postulates, as Anscombe and Aumann did from the orig- 
inal postulates. Subjective probabilities are numbers, not matrices as in 
the Subjective Expected Lexicographic Utility approach. JEL no.: D81 
Keywords: Utility Theory, Non-Standard Utilities, Qualitative Decision 
Theory 

1 Introduction 

This paper proposes a deviation from the von Neumann-Morgenstern 
(vNM) postulates paradigm in decision theory. It suggests that it may, in 
certain circumstances, be rational to judge alternatives according to the 
issues in their main focus. If these issues are deemed as equal, the alter- 
natives will continue to be judged as equal even if they are mixed with 
different side-effects - side-effects which would not be judged as equal were 
they to be in the main focus themselves. This contradicts the vNM In- 
dependence axiom. Moreover, outcomes of issues in the main focus may 
completely overshadow the outcomes of the side-issues, so alternatives of 
the former may be judged as infinitely more (or infinitely less) preferable 
than those of the latter. This contradicts the vNM Continuity axiom. 

Suppose you have to choose between two lotteries. In the first lottery 
you may win, with probability p, a week's vacation in Hawaii. With prob- 
ability 1— p you get nothing. In the second lottery you may win, with the 
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same probability p, the same vacation in Hawaii, but, with probability 
1 — p you get a consolation prize: a free copy of your favorite magazine. 
Since the free copy is preferred to nothing, vNM's independence postulate 
implies that lottery two is preferred to lottery one. But couldn't a ratio- 
nal decision maker be indifferent between the two lotteries. One, often, I 
think, buys a lottery ticket in a frame of mind focused on the big prize 
and not on the consolation prize. This behavior is by no means general, 
as attested by the fact lotteries often offer consolation prizes, but should 
a decision maker indifferent between the two lotteries be considered irra- 
tional in all situations? I think not. 

A variation on this example considers also a third lottery, in which one 
wins a trip to Paris with the same probability p as above, and nothing 
with probability 1 — p. Suppose you try to compare lotteries one and 
three. You ponder at length the advantages and disadvantages of the two 
vacation spots, and decide you are indifferent between the trip to Hawaii 
and the trip to Paris, all relevant considerations taken into account. You 
conclude that you are also indifferent between the lotteries one and three. 
The independence axiom of von Neumann and Morgenstern implies that 
lottery two is preferred to lottery three. But it has been argued that it is 
quite unreasonable to expect the very slight improvement that lottery two 
presents over lottery one to overcome the lengthy and delicate deliberation 
that made you conclude that the trips to Hawaii and Paris are equivalent 
for you. 

Similar examples have been put forward to argue that the indifference 
relation is not always transitive: lottery three is equivalent to lottery one 
and to lottery two, but lottery two is preferred to lottery one. The system 
presented in this paper endorses the transitivity of indifference, but allows 
a decision maker to be indifferent between lotteries one and two. 

Let us consider now a second situation. A patient has to choose be- 
tween two options: 

f . (option p) do nothing and die in a matter of weeks, 

2. (option q) undergo surgery, the result of which, depending on some 
objective probabilities, may be a long and happy life (denoted by I) 
or an immediate death on the operation table (denoted by d). We 
shall denote by A the probability of the surgery being successful, i.e., 
the probability of I. The probability of death on the operation table 
is, therefore, f — A. 

In other terms, one has to compare mixtures p and A I + (1 — A) d. Assum- 
ing one prefers I to p and prefers p to d, vNM's postulates imply what we 
shall call property P: there is a unique A G]0, 1[ for which one is indifferent 
between p and A I + (1 — A) d. For any /i > A, one prefers jj, I + (I — /i) d 
to p, and for all fi < A, one prefers p to p,l + (1 — p) d. If one thinks that 
a long and happy life is overwhelmingly preferable to p so as to make 
the distinction between p and d insignificant, i.e., that fil + (I — fi) d is 
preferable to p for any jj, G]0, 1 [, property P fails and one deviates from 
vNM's rationality postulates. 

But would we really dismiss as irrational such a behavior, or such a 
preference? After considering the question, in this section, I will pro- 
pose a weakening of vNM's postulates that allows for the preference of 
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fil + (1 — fx) d over p for any ^ e]0, 1[. 

Von Neumann-Morgenstern's point of view is perfectly acceptable and 
I have no criticism for someone who adheres to it and decides there is 
indeed some very close to zero, perhaps, such that p is equivalent to 
/i I + (1 — y?) d. My only claim is that someone who thinks /i I + (1 — fi) d 
is preferable to p for any fi 6]0, 1[ cannot be considered irrational outright. 

An argument, very similar to the one just presented, for preferring 
a mixture (xl + (1 — n) d to some p, for any /i G]0, 1[, even though p is 
preferred to d, appears in Pascal's fed]. There I denotes eternal bliss (the 
reward of the believer if God exists), d denotes a life spent in error by 
a believer in a God that does not exist, and p denotes a life spent by a 
non-believer. This argument, known as Pascal's wager, is very well-known 
and the reader may find in a previous version of this work |22|, a fuller 
discussion. 

Before entering a technical description, I will, in short, describe intu- 
itively the reason for the failure of property P in the system presented in 
this work, Expected Qualitative Utility Maximization. In the examples 
above one may assume that consequence I is infinitely preferable to p and 
d. This will be technically translated in giving an infinite value to the 
utility of I, whereas p and d have finite utilities. For von Neumann and 
Morgenstern, there are no infinite utilities. This work develops a frame- 
work in which there are infinite utilities, by using nonstandard (in the 
sense of A. Robinson [p5Q_ utilities. 

A number of papers q, ^] discussed, in the setting of the St. Pe- 
tersburg's paradox, the existence of unbounded utilities. In the last of 
these papers, Aumann argues very convincingly that utilities should be 
bounded. At first sight, one may think that infinite utilities imply un- 
bounded utilities, and therefore Aumann argues also against infinite util- 
ities, but this is not the case. His argument may be summarized in the 
following way: if utilities were unbounded, for any A G]0, 1[ there would be 
a consequence (e) such that a lottery Ac+(I — A)dis preferred to a long 
and happy life (I). But this seems very unreasonable to Aumann. His 
argument is directed against unbounded utilities, but ineffective against 
infinite utilities. Certainly, no consequence is infinitely preferable to I 
and therefore, if there are infinite utilities, the utility of I is infinite. But 
there is absolutely no problem if one assumes that the utility of / is in- 
finite and maybe even maximal (nothing is preferred to I). In this case, 
Aumann's argument disappears. The fact that I is infinitely preferred to 
some other consequence, d for example, or a sum of money, will influence 
the preferences of a decider between lotteries involving I and consequences 
such as d. 



2 Background 

Utility theory is discussed in the framework of ji^, Chapter 3], see also H| . 
Let Tt be a boolean algebra of subsets of X, and P a convex set of prob- 
ability measures on TL. Convex means here that: 

Vp, q e P, va e]o, f[, Xp + (l - \)q e P. 
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Here ]0, 1[ denotes the standard open real interval. Von Neumann and 
Morgenstern have characterized the binary relations > on P that can be 
defined by a linear functional u on P in the following way: 

Vp,q e P, v > q o «(p) > u{q). (1) 

In Equation |l[ the functional u is a function from P to the standard set 
of real numbers R and the relation > in the right hand side is the usual 
strict ordering on R. 

Their characterization is equivalent to the following, due to Jensen Jk3| 
(see Jll], p. 1408]) three conditions, for all p,q,r £ P and all A G]0, 1[ (a 
weak order is an asymmetric and negatively transitive binary relation): 

Al > on P is a weak order, 

A2 p > q =>■ \p + (1 - X)r > Xq + (1 - A)r, 

A3 (p>q,q>r) 3a,/3e]0, 1[, such that 

ap + (1 - a)r > q > ftp + (1 - j3)r. 

The three conditions above are not the original postulates of von Neumann 
and Morgenstern, they are equivalent to them. They will be referred to, 
nevertheless, in this work, as vNM's postulates. A2 is usually denoted In- 
dependence and A3 Continuity. The purpose of this work is to generalize 
von Neumann and Morgenstern's characterization to deal with qualitative 
utilities. In the sequel, p > q will denote q ~£ p and p ~ q will denote the 
conjunction of p > q and q > p. 



3 Qualitative utilities 

Qualitative decision theory has been developed mostly in opposition to 
quantitative decision theory, stressing decision methods that do not sat- 
isfy vNM's or Savage's J2(| postulates, the postulates generally accepted 
for quantitative decision theory. The focus in qualitative decision theory 
has always been on methods and algorithms, more than on an axiomatic 
treatment is an exception). 

A different approach is proposed here: qualitative and quantitative de- 
cision theories can be viewed as special cases of a unified general theory of 
decision that contains both. This unified theory is a generalization of the 
quantitative theory. The power of the generalization lies in the consider- 
ation of nonstandard models of the set of real numbers for utilities and a 
definition of indifference that neglects infinitesimally small differences. In 
this paper probabilities will always be standard. The case of nonstandard 
probabilities and standard utilities has been treated, after the elaboration 
of this paper, in 

|3 ■ Preliminary ideas already appeared in @ and §J. 
A well-established tradition in Decision Theory considers Expected 
Utility Maximization as the only rational policy. Following this view, an 
act / is strictly preferred to an act g iff the utility expected from / is 
strictly larger than that expected for g. Since expected utilities are real 
numbers, strictly larger has its usual, quantitative meaning. The main 
claim of this paper is that the qualitative point of view may be subsumed 
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by a slightly different definition of strictly larger. Suppose we consider 
any model elementarily equivalent to the real numbers, more precisely, 
any (standard or nonstandard) model of the real numbers, 1Z (for the 
standard model, we shall use R) . Let x and y be elements of 1Z. To make 
matters simpler, suppose that both x and y are positive. The number x 
is quantitatively larger than y iff x — y > 0. What could be a reasonable 
definition of qualitatively larger? Clearly, if x is qualitatively larger than y 
then it must be quantitatively larger: in a sense qualitatively larger means 
definitely larger. A first idea that may be considered is to use a notion 
that proved fundamental for nonstandard analysis (the monads of 0|, or 
see Jl6|): the notion of two numbers being infinitely close, and consider 
that a number x is qualitatively larger than a number y iff x is larger 
than y and not infinitely close to y, i.e., iff x — y is strictly larger than 
some positive standard number. At first this idea looks appealing: if e 
is strictly positive and infinitesimally close to zero, and a; is a standard, 
strictly positive, real, we do not want x + e to be qualitatively larger 
than x. At a second look, one realizes that the size of x — y should not 
be judged absolutely, but relatively to the size of x: for example e 2 + e 
should be qualitatively larger than e 2 . Therefore I propose the following 
definition: 

Definition 1 Let x and y be positive. We shall say that x is qualitatively 
larger than y and write x y y iff is strictly positive and not infinitesi- 
mally close to zero: in other terms, iff there is a strictly positive standard 
number r such that ^—^ > r. 

x — 

To the best of my knowledge, the idea of comparing nonstandard numbers 
qualitatively, i.e., by >- and not by the usual ordering > is original. Notice 
also that Definition [l] relies on the notion of a nonstandard number, and 
that this notion is not first-order definable. We may therefore expect 
for the qualitative order properties that are quite different than the ones 
enjoyed by the usual order. The qualitative order is not a lexicographic 
ordering. It will be shown in Section ^ that its properties are very different 
from those of lexicographic orderings. 

The definition may be extended to arbitrary numbers in the obvious 
way: 

1. if x > and > y, then x y y, and 

2. x y y iff — y > x, 

but we shall limit ourselves to the consideration of positive utilities in this 
paper, x <y shall denote x )f y and x ~ y shall denote that x <y and 
y < x. Properties of the qualitative ordering y are described and proved 
in Appendix A. 

Note that x < y does not imply x — c < y — c. If e is positive and 
infinitesimally close to zero, 1 + e X 1 but 1 + e— (1 — e 2 ) -£ e 2 . Note also 
that >- is not complete and that X is not antisymmetric. Notice that, if 
we choose, for 1Z, the standard model of the reals, R, then x y y iff 
x > y. Therefore our treatment would include the classical approach, 
if we allowed also negative utilities. As said above, in this paper, we 
concentrate on the case all utilities are positive. Is our framework, with 
positive nonstandard utilities, a generalization of the classical theory, with 
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standard positive and negative utilities? Since, in the classical setting, 
utilities are denned only up to an additive constant, bounded utilities may 
always be considered to be positive, by adding a positive large enough 
constant. In view of Aumann's M critique of unbounded utilities, we 
feel that the present framework encompasses the most important part of 
classical theory. 

Expected Qualitative Utility Maximization is the version of Expected 
Utility Maximization that obtains when, for utilities, 

• the model chosen for the real numbers may be nonstandard, and 

• real numbers are compared qualitatively, i.e., by y. 

We want to characterize the binary relations > on P that can be defined 
by a linear functional u : P — » TZ+ in the following way: 

Vp,g G P,p > q <^> u(p) y u{q). (2) 

One could, as well, consider functionals of the type: u : P — > 1Z, but the 
characterization of relations obtained in such a general way is more intri- 
cate than the task proposed in this paper and is left for future work. We 
shall note the main difference between the two characterizations in the 
sequel. One should immediately notice that, by Lemma ^| part ^, if c > 0, 
the utility function cu(p) defines the same ordering as u(p). But, contrary 
to what happens both in the classical and in the lexicographic ordering 
settings, if d 6 1Z the function d + u(x) does not, in general, define the 
same ordering as u(p): consider Lemma ^ part [ll]. Such an instability un- 
der an additive constant, and in particular an asymmetry between gains 
and losses has been found in the behavior of decision makers in many in- 
stances p"o| |l4| , p7[ . The question of whether Expected Qualitative Utility 
Maximization, in the present form, or in the generalized version that al- 
lows for negative utilities, is a realistic model for explaining such behavior 
cannot be discussed in this paper. 



4 Maximin as Expected Qualitative Util- 
ity Maximization 

As noticed above, Expected Qualitative Utility Maximization general- 
izes Expected Utility Maximization: if one chooses the standard model 
for real numbers then Expected Qualitative Utility Maximization boils 
down exactly to Expected Utility Maximization, at least when utilities 
are bounded. We shall show now that considering nonstandard utilities 
enables us to obtain decision criteria that do not satisfy vNM's postulates 
and were so far considered as part of the realm of qualitative decision the- 
ory. A version of the Maximin criterion will be presented. The Maximin 
criterion has been proposed by A. Wald |3l], in a different framework. 
The criterion to be presented is a variation on this theme. 

Notice that any bona fide Maximin criterion violates Independence, 
and is therefore not obtainable by a lexicographic ordering, since all 
such methods satisfy Independence. Suppose p y q y r. Then, under 
the maximin criterion Ar+(1 — \)p must be considered indifferent to 
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Xr + (1 — Xjq since in both the worst possible outcome is the same and 
obtains with the same probability, violating Independence. 

Assume the set X is finite and Ti. contains all subsets of X. Let the 
elements of X be xo, . . . ,x n -i- Let e be a number that is positive and 
infinitesimally close to zero and let our utility function u be the linear 
function defined by: u(xi) = — e n_l_1 , for i = 0, . . . , n — 1. Notice that, 
exceptionally, we consider here negative utilities. Notice that Xi < Xj iff 
i < j. The utility of a mixture Xxi + (1 — X)xj is — Ae n_I_1 if Xi < Xj and 
— e n_1_1 if Xi ~ Xj. Suppose i < j and i' < j'. Then, Xxi + (1 — X)xj < 
fix^ + (1 — n)xji holds iff Xi < Xii or x% ~ ov and A > /j,. The decision 
maker therefore compares different mixtures by comparing the worst pos- 
sible outcomes and, if they are the same, their respective probabilities. 
This is some form of Maximin criterion and does not satisfy A2 or A3, 
but it has been considered a rational way of deciding by many authors, 
and it is amenable to Expected Qualitative Utility Maximization. 

5 Postulates 

Suppose > is defined by some functional u as in Equation ^. First, one 
easily sees that the relation > defined by Equation ^ is a weak order since 
y is a weak order. Therefore Al holds. 

Let us know consider A2. We shall see that A2 does not hold. Let e 
be positive and infinitesimally close to zero. Let u(p) — 2 x e, u(q) = e and 
u(r) = 1. Then 0.5 x 2 x e + 0.5 ~ 0.5 x e + 0.5 and 0.5p + 0.5r ~ 0.5q + 0.5r. 
Let us find a weakening of A2 that holds. Assume now that p > q, i.e., 
u(p) y u(q). Let A € Ft, be a standard real number, < A < 1. Let us 
compare Xp + (1 — A)r and Xq + (1 — X)r. Since it is linear, 

u(Xp+ (1 - A)r) = Xu(p) + (1 - A)w(r) 

and 

u(Xq + (1 - A)r) = Xu(q) + (1 - X)u(r). 

ByLemma^l parts |Io| and pd], two cases must be considered. If (1 — X)u(r)/Xu(p) 
is finite, i.e., if u(r)/u(p) is finite, then, 

Xu{p) + (1 - X)u{r) y Xu{q) + (1 - A)u(r), 

and therefore Xp + (1 — A)r > Ag + (1 — A)r, which corresponds exactly 
to A2 above. If, on the contrary, u(r)/u(p) is infinite, then, for any 
A' E]0, 1[ (the standard unit interval), 

(1 - A')u(r) ~ A'w(p) + (1 - A')w(r) ~ A'u(g) + (1 - A')w(r) X u(p). 

To formulate our independence property, it is best to set the following 
definition. 

Definition 2 We shall say that p overrides q and write p ;§> q iff p > q 
and for any q' such that q > q and for any X £]0, 1[, Xq + (1 — X)p ~ 
Ag' + (1-A)p. 
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The intuitive meaning of p S> q is that p is so much preferred to q that, 
in any lottery in which p and q are the prizes, if one does not win p, one 
does not even care to cash q, but would as well get any lesser prize q' . 
Notice that, since > is asymmetric, the relation 3> is also asymmetric and 
therefore irreflexive. The following lemma describes the tight relationship 
between the properties p> q and u(p)/u(q) is infinite. 

Lemma 1 If the relation > is defined by a linear functional as in Equa- 
tion ^, then p> q iff either u{p)/u{q) is infinite, or p > q and q < r for 
any r £ P. 

Proof: Let us proof the if part. If q < r for any r £ P and p > q, 
then obviously p>ij. If u(p)/u(q) is infinite, then u(p) y u(q) and, if 
u(q) > u(q'), 

Xu(q) + (1 - X)u(p) ~ (1 - A)u(p) ~ Au(g') + (1 - X)u(p). 

Let us prove now the only i/part. If u(q) y u(q') and 

Au(?) + (1 - A)u(p) ~ Au(g') + (1 - A)u(p), 

then A(u(g) — u(q')) / (Xu(q) + (1 — A)w(p) is infinitesimally close to zero 
and therefore 

u(q) 1 - A u{p) 

u(q) - u(q') A u(q) - u{q') 

is infinite. But u(q) y u(q') implies the first term is not infinite. Therefore 
the second one is. Then u(p)/(u(q) — u(q')) is infinite. But u(q) — u(q') > 
711(g), for some standard positive 7, u(p)/(u(q) — u(q')) < u(p) /'yu(q) and 
u(p)/u(q) is infinite. Our independence property may now be formulated 
as: 

A'2 p > q, r > p ^ VA 6]0, 1[ Xp + (1 - A)r > Ag + (1 - A)r. 

The intuitive meaning of A'2 is that any lottery is sensitive to both its 
prizes, unless one of the prizes overrides the other one. 

Let us study now property A3. Let us show it does not hold ei- 
ther. Let e be positive and infinitesimally close to zero. Let u(p) = 1, 
u(q) — 2e, u(r) — e. We have p > q > r, but for any (3 €]0, 1[, u(q) < 
I3u(p) + {1-P)u(r). 

Let us find a sound weakening of A3. Assume p > q> r. We have 
u(p) y u(q) y u(r). Consider the values au(p) + (1 — a)u(r) for the 
different values of a £]0, 1[. Since u(p) y u(q), there is some standard 
7 > such that (u(p) — u(q)) / u(p) > 7. We have (1 — 7)u(p) > u(q). Let 
a = 1 — 7, a £]0, 1[. We have 

au(p) + (1 — a)u(r) = (1 — "f)u(p) + ju(r) > u{q) + ju(r) > u(q). 

Take any a' > a, a' < 1. We have a'u(p) + (1 — a')u(r) y u(q). We have 
shown that a'p + (1 — a')r > q. 

Let us now consider the existence of a (3 £]0, 1[ such that q > (3p+ (1 — 0)r. 
We have u{q)/u(p) y u(r)/u{p). If u(q)/u(p) is not infinitesimal, there is 
some standard 7 < 1 such that u(q)/u(p) y 7 y u(r)/u(p). If f3 > ap- 
proaches zero, (7 — /3)/(l — /3) approaches 7 from below. There is there- 
fore some standard /3 G]0, 1[ such that 7 V (7 — — /?) V w(r)/it(p). 
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Therefore, we have (7 — P)u(p) y (1 — (3)u(r), and ju(p) y (3)u(p) + (1 — 0) 
But u(q) y ju(p). We conclude that q> (3p+(l — {3)r. If, on the 
contrary, u(q)/u(p) is infinitesimal, for any f3 £]0, 1[, /3u(p) y u(q) and 
/3p + (1 — /3)r > g. In this case, note that, for any j3 G]0, 1[, 

0u(p) + (1 - (3)u(r) ~ 0t»(p) ~ /8u(p) + (1 - /3)u(«). 

We conclude that the following properties hold: 

A'3 p> q > r 3a e]0, 1[ such that ap + (1 — a)r > g. 

A"3 p> q> r,p^> q => 3/3 G]0, 1[ such that 5 > /3p + (1 - /3)r. 

6 Representation Result 

All the technical work needed to prove our theorem may be found in Ap- 
pendix B. The general structure of the proof is very similar to that of the 
classical proof of the completeness of Jensen's postulates for representa- 
tion by a standard linear functional. Nevertheless, there are a few subtle 
points, since one has to carefully avoid using those properties that hold 
in the standard case but do not hold here. The main result of this work 
may now be presented. 

Theorem 1 // the set P is finitely generated, then the relation > satisfies 
Al, A'2, A'3 and A"3 iff there is some nonstandard model 1Z and some 
linear functional u : P — > 1Z+ such that Vp, q G P, p > q iff u(p) y u(q). 

The proof of Theorem |l| is contained in Appendix B. One may certainly 
weaken the restriction to a finitely generated P a bit, but some restriction 
is needed here. The following example will show that Theorem [l] does not 
hold if one removes the condition that P be finitely generated. Consider, 
for example, any nonstandard model of the real numbers and let P be 
the subset including all positive numbers that are neither infinite nor 
infmitesimally close to zero. Let us consider the usual ordering > {not y) 
on P. This ordering is easily seen to satisfy vNM's postulates. Suppose 
there is a nonstandard model TZ and a linear function u : P — > 1Z+ such 
that Vp, q £ P, p > q iff u(p) y u(q). Since postulate A2 (independence) 
holds, the image of u has to be contained in one single equivalence class 
under x. All such equivalence classes are isomorphic (by multiplication). 
We may therefore assume that the image of u is contained in the class 
of numbers that are neither infinite nor infmitesimally close to zero. Any 
member of this class is ^-equivalent to a unique standard real. We may 
therefore take u into the standard real numbers. But this is impossible 
if the nonstandard model chosen has a cardinality that is larger than the 
continuum. In this case, P has the same cardinality and, since u must be 
one-to-one, its image has a cardinality larger than that of R. 

7 Comparison with previous work 

Numerous works during the fifties and the sixties considered weakenings 
of vNM's postulates, see 111] for a survey. Some of these weakenings try 
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to describe the actual preferences of human deciders and reject the In- 
dependence property A2. Often they also reject the requirement that 
preferences be transitive, or that indifference be transitive. Others, based 
on lexicographic orderings, keep the Independence postulate and reject 
only the Continuity postulate A3: jl|, §, |, |, § §0, |j| . Nonstan- 
dard analysis pal ap peared late on the scene. Few authors applied it to 
decision theory: jg9| |l5[ . 

This work proposes an original weakening based on nonstandard anal- 
ysis. We shall describe its relation to lexicographic orderings first, and 
then to other uses of nonstandard analysis in decision theory. 

The motivation for this work is, in fact, opposite to the basic mo- 
tivation for considering lexicographic orderings. The motivation for the 
consideration of lexicographic orderings on probabilities is the consider- 
ation of those perfection refinements of Nash Equilibria which required 
optimization also off the equilibrium path, on zero-probability events. Re- 
placing the zero probabilities by infinitesimal probabilities and requiring 
optimization in the usual sense (i.e. with the usual linear ordering on 
(non-standard) numbers) gives the desired result. The current paper is 
trying to achieve exactly the opposite - "side issues" should not matter, 
and hence the special ordering proposed. 

For a more technical comparison, notice that our postulates are very 
close to the original postulates of von Neumann and Morgenstern. In 
particular the ordering < is modular (weak total) and the indifference 
relation ~ is transitive. But both A2 and A3 are weakened, in a closely 
linked manner. Notice that lexicographic orderings define a preference 
relation that satisfies A2, and that A2, A'3 and A" 3 together imply A3, 
since A2 says that p ^> q implies that for any w, w > q. The weakening 
offered by lexicographic orderings is therefore orthogonal to ours: any 
lexicographic ordering that satisfies our postulates satisfies the full set of 
vNM's postulates. 

To explain better the difference between lexicographic orderings and 
our qualitative ordering, assume P is the real plane R 2 ordered by the 
lexicographic ordering: 

(x, y) < {x , y') iff either x < x' or x = x and y < y' . 

For A G [0, 1], define X(x, y) + (1 - X)(x', y') to be (Ax + (1 - X)x', \y + (1 - X)y'). 
Notice that (0,0) < (1,10) < (2,0), but there is no A G]0, 1[ such that 
(1, 10) = A(0, 0) + (1 - A)(2, 0) since A(0, 0) + (1 - A)(2, 0) = (2(1 - A), 0). 
Both lexicographic and qualitative orderings imply the failure of property 
P of section dj. But notice that lexicographic ordering also implies the 
failure of Lemma [To] since there exists some /3 E]0, 1[ such that: 

(1, 10) > /3(2, 0) + (1 - /3)(0, 0) = 0(2, 0), 

for example /3 = 0.4, and nevertheless there is no A as above. Lexico- 
graphic and qualitative orderings stem from different concerns and have 
very different characteristics. 

The previous uses of nonstandard numbers mentioned above consider 
the usual ordering on those nonstandard models, not the qualitative or- 
dering we consider. Most of the considerations of f29| concerning strategic 
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games in which some pay-offs are infinite are vahd in the present frame- 
work too, and therefore very relevant for further work. 



8 Subjective probability 

In [ffl, Anscombe and Aumann showed that, in a slightly modified frame- 
work in which the decider compares not lotteries but acts the outcomes 
of which depend on the state of nature, an additional very natural postu- 
late is sufficient to ensure the existence of subjecti ve p robabilities, in t he 



In 3.5 and B.3 it 



decider's mind. This result is described in Section 8.1. 
is shown that the same holds, with minimal changes, for Expected Qual- 
itative Utility Maximization. This result must be contradistincted with 
LaValle and Fishburn's JTjj ], showing that, in the Lexicographic Subjective 
Expected Utility framework, subjective probabilities have to be matrices 
rather than numbers. 



8.1 Anscombe- Aumann's framework 

Let P be a convex set of probability measures onH, as in Section^. In jij], 
Anscombe and Aumann consider a finite set S (of states) and the set F 
(of acts) of mappings: S — ► P. The set F is a mixture set when, for 
a, b e F, A e [0, 1], one defines [Ao + (1 - A)6](s) as Aa(s) + (1 - X)b(s). 
If / is an element of P we shall identify it with the constant function 
h £ F defined by h(s) = f for any s £ S. They consider binary relations 
(>) on F that may be defined a probability measure p on S and a linear 
function u : P > R by: 

a> b<^> V\(s)w(a(s)) > y^p(s)u(b(s)). 

ses ses 

Assuming P is finitely generated (in fact they have a slightly weaker con- 
dition), they show that a relation > on F may be defined by a probability 
measure p on S and a linear u in the way above iff > satisfies Al, A2, A3 
(where > is defined on F) and one additional postulate. For any a, b £ F 

A'4 If Vs 6 S, s s => a(s) = b(s), then a > b => a(s ) > b(so). 

In the last part of A'4, a(so) and b(so) stand for the corresponding con- 
stant functions. 



8.2 Additional Postulate 

We shall need an additional postulate, specific to our consideration of 
nonstandard utilities. A definition will be handy. Roughly, an element t 
of S is null iff the singleton {£} is Savage-null, i.e., if the value taken by 
an act on t is insignificant. 

Definition 3 Let t G S. The element t is said to be null iff for any 

a, b £ F we have a ~ b if a and b agree everywhere except possibly on t, 
i.e., for any s =£t, a(s) — b(s). 
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Our last postulate ensures that probabilities are standard. Assume t € S, 
a € F and one of the possible values of a, a(t), overrides a, i.e., a(t) a. 
It must be the case that t is null. 

A' 5 t e S, a e F, a(t) > a t is null. 

A first consequence of A'4 shall be proved now. 

Lemma 2 Assume Al and A'4 hold. If a(s) ^ b(s) for any s £ S, then 
a<b. 

Proof: By induction on the number of elements s of S for which 
a(s) b(s), using A'4. 

8.3 Characterization Theorem 

A theorem similar to Anscombe and Aumann's holds for Expected Qual- 
itative Utility Maximization. 

Theorem 2 Assume P is finitely generated and > is a binary relation 
on F. There is a probability measure p on S, a nonstandard model 1Z and 
a linear function u : P — > 1Z+ such that Va, b G F, 

a > b ^2p(s)u(a(s)) y y^p(s)u(b(s)) (3) 

ses ses 

iff the relation > satisfies Al, A'2, A'3, A"3, A'4 and A'5. // the 

relation > on P is not trivial, the probability measure p is unique. 

The proof may be found in Appendix C. Its general structure is similar 
to Anscombe and Aumann's, but there are a number of steps that have 
to be managed in a different manner. 

9 Conclusion 

Nonstandard models of the real numbers provide for a natural notion of 
qualitative equivalence and a principle of Qualitative Utility Maximiza- 
tion. This work characterizes in full the situation in which one allows non- 
standard utilities but insists on standard probabilities. In this framework 
one may consider consequences that are infinitely preferable to others and 
criteria of the Maximin family. Subjective probabilities may be shown to 
exist as in the classical framework. They are numbers, not matrices, as 
in the Lexicographic Subjective Expected Utility framework. This rep- 
resents probably a clear advantage for Qualitative Utility Maximization 
over lexicographic methods. But both are really orthogonal extensions of 
the classical Expected Utility Maximization paradigm. 

The study of games with nonstandard utilities seems appealing. The 
dual case of nonstandard probabilities and standard utilities and the most 
general case of nonstandard probabilities and utilities are yet to be char- 
acterized. They will include consideration of subjective probabilities in- 
finitesimally close to zero. 
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A Properties of the Qualitative Ordering 

The following lemma summarizes the main properties of the relations just 
defined. Let 1Z+ be the subset of 1Z consisting of all positive numbers 
(including zero). 

Lemma 3 For any x,y,z £ 1Z+ 

1. x y y =>• x > y, 

2. x > x y 0, 

3. the relation y is asymmetric: i.e., x y y ^ y < x, 
4- x y y and y > z imply x y z, 

5. x > y and y y z imply x y z, 

6. the relation y is transitive, 

7. the relation y is negatively transitive, i.e., modular: i.e., x < y and 
y ^ z imply x ^ z, 

8. the relation ~ is an equivalence relation, 

9. if c > 0, then x y y iff cx y cy, 

10. if x y y, c > and c/x is finite, then x + c y y + c. 

11. if x y y, c > and c/x is infinite, then, for any standard positive 
A, /i, v , Ac ~ /ix + Ac ~ fiy + Ac y ux, 

12. if x y y, c > and y — c > 0, then x — c >- y — c. 

Proof: Parts [l] and |^ are obvious from the definition of >-. 
Part |^ follows from part |l[ 

For part i, notice that x — z > x — y and (a; — z)/x > (x — y)/x. 
For part 5, note that x — z > x — y and (x — z)/x > (x — y)/x. 
Part |^ follows from parts [l], ^ and [| 

For part ^, assume x y y. We shall show that either x y z or z y y. 
If y < z or z < x we conclude by parts ^| or We may therefore assume 
that x > z > y. Notice that 

(x — y)/x — (x — z)/x + (z — y)/x < (x — z)/x + (z — y)/z. 

Since the left hand side is not infinitesimally close to zero, at least one 
of the terms in the sum in the right hand side must be larger than some 
standard number and we have shown that the relation >- is negatively 
transitive. It follows that the relation < is transitive. It is reflexive by 
part |l|. The relation ~ is therefore reflexive, transitive and symmetric, 
and partH is proved. 
Part Wis obvious. 

For part [H| assume x y y. We have x > y. Therefore x + c > y + c. 
Consider 

(x + c)-(y + c) = x-y = x-y x 

X + C X + C X X + c 

If c/x is finite, so is (x + c)/x and x/(x + c) is not infinitesimally close to 
zero. But x y y implies that (x — y) jx is not infinitesimally close to zero. 
We conclude that x + c y y + c. 
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For part O, assume c/x is infinite. Both fj,x/Xc and fiy/Xc are in- 
finitesimally close to zero. Therefore Ac ~ fix + Ac ~ M3/ + ^ c an( A ^ 

For part^| notice that x — c > y — c and [(a; — c) — (y — c)]/(x — c) > 
(x — y) fx. So far, the reader may get the feeling that the qualitative order 
is just like the usual one. This would be a mistaken impression. Note that 
x < y does not imply x — c ^ y — c. If e is positive and infinitesimally 
close to zero, 1 + e X 1 but 1 + e — (1 — e 2 ) ^ e 2 . Note also that >- is 
not complete and that X is not antisymmetri c. A sequence of technical 
lemmas will be stated now and used in Section |8^ . Had we used the usual 
order >, they would have been obvious, for -< they are not. 

Lemma 4 Let A £]0, 1[ be a standard real number. Assume a,b,c£ 1Z+ 
such that a — \b + (1 — A)c, a < b, a < c. Then, a ~ b and a ~ c. 

Proof: Suppose, without loss of generality, that b < c. Then b < a < c. 
Clearly b ^< a and a ~ o. But c — a = yrj( a — 6)- If is infinitesimally 
close to zero, so is and a ~ c. 

Lemma 5 Let n > 0, Ai > 0, i = 0, . . . , n — 1, standard real numbers such 
that 5^™_ Aj = 1. Let a,ai, i = 0, . . . ,n — 1 fee elements of a nonstandard 

model TZ+ such that a — ^27=0 ^ iCLi an d a — ai f or an V * = 0, . . . ,n — 1. 
Then, for any i = 0, . . . , n — 1, a ~ a». 

Proof: By induction on n. The case n — 1 is obvious. The case n = 2 
is dealt with by Lemma [l|. For the general case, consider that 

re-l 

a = A a + (1 - Ao) 7 - — 

z — ' 1 — A 

i=l 

and use Lemma ^ to conclude that a ~ ao. Similarly for a.;. 

Lemma 6 Let n > 0, Aj > 0, i = 0, . . . , n — 1, standard real numbers such 
that y^"^ 1 Ai = 1. Let a, ai, i = 0, . . . , n — 1 be elements of a nonstandard 
model 1Z+ such that a — y^?_ n XiOi and a X ch for any i = 0, . . . , n — 1. 
Then, for any i = 0, , n — 1 smc/i t/iat A^ > 0, a ~ aj. 

Proof: By induction on n. The case n = 1 is obvious. For the general 
case, if, for some i Aj = 0, use a straightforward induction argument. If, 
for any i, \ > 0, use Lemma H. 



B Derivation of the completeness result 

We assume that the postulates AI, A'2, A'3 and A"3 hold and derive 
some consequences. In most cases, the derivation is very similar to the 
classical case, but we have to do with the weaker assumptions. First, 
notice that, since p>5 implies p > q and, by AI, the relation > is asym- 
metric, so is 3>. In particular, 3> is irreflexive. 

Lemma 7 Assume p > q, A G]0, 1[. Then, p > Xp + (1 — X)q > q. 
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Proof: Assume p > q. We know that p j£> p, therefore, by A'2, for 
any fi e]0, 1[, fMp + (1 — /i)p > fiq + (1 — ^i)p. By taking, fi = 1 — A, for 
any A £]0, 1[, p > (1 — A)g + Ap. But we know also that q~$> p and there- 
fore we have Xp + (1 — A)g > Ag + (1 — X)q. The next lemma is most 
important. 

Lemma 8 Assume p > q, A, /J, € [0, 1], and X > /i. Then, Xp+ (1 — A)g > 

MP + (1 - M)<7- 

Proof: Note that /it < 1. 

Xp + (1 - A)« = ^— ^p + i— ^[/xp + (1 - fi)q] 

By Lemma Q p > fip+ (1 — /i)g. Therefore fip + (1 — /i)g ^> p and, by 
A'2, 

X — u 1 — A , ,„ . . 
1 -P+r. [fJ.p+ 9 > 

Corollary 1 Let X, fj, £ [0,1]. If Xp + (1 — A)g ~ fip + (1 — fi)q, then ei- 
ther X — or p ~ q. 

Proof: Let Ap + (1 — A)g ~ up + (1 — fi)q. Assume, without loss of gen- 
erality, that p > q. By lemmapl if A > fi, we have Ap + (1 — X)q > fip + (1 - 
We conclude that fi < A, and, similarly, A < fj,. 

Corollary 2 For any p,q,r £ P, if p > g, i/iere is at most one X £ [0, 1] 
such that r ~ Ap + (1 — A)g. 

Proof: Obvious from Corollary 

Lemma 9 7/p 3> q and q > r, then p r. 

Proof: Let p ^ q and q> r. Let r' be such that r > r'. We shall 
show that, for any A £]0, 1[, Ar + (1 — A)p ~ Xr' + (1 — A)p. We have, 
q> r, q > r' and p>g. Therefore Ag + (1 — A)p ~ Ar + (1 — A)p and 
Ag + (1 - A)p - Ar' + (1 - A)p. 

Lemma 10 Let p > q > r. If one assumes that there exists some j3 £]0, 1[ 
such that q > f3p + (1 — (3)r, then there exists some 7 G]0, 1[ such that q ~ 
7P + (1 — j)r. 

Proof: By A'3, there is some a £]0, 1[ such that ap + (1 — a)r > g. 
Let 71 be the infimum of the set {a | ap + (1 — ot)r > g} and 72 be the 



supremum of the set {/3 
non-empty). By Lemma 



q > Pp + (1 — P)r} (by assumption this set is 
I) 7i > 72- Take any 7 such that 71 > 7 > 72- 



The choice of 71 and 72, together with Al imply that q ~ Ap + (1 — A)r. 

Corollary 3 Letp > q > r, p > r and p j£> r. Then, there exists a unique 
X £ [0, 1] such that q ~ Ap + (1 - A)r. 
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Proof: Uniqueness has been shown in Corollary g. Let us show ex- 
istence. If p ~ g or g ~ r, one can take A to be equal to one or zero 
respectively. We may therefore assume that p > q > r and p~^> r. By 
Lemma |i| p ^> q. By A" 3 the assumptions of Lemma JHj hold and the 
existence of a suitable A is ensured. 

Lemma 11 Ifp > p' and g > q , then, for any A G [0, 1], Xp + (1 — A)g > 
Ap' + (1-A)g'. 

Proof: The cases A = and A = 1 are easily treated. Assume A e]0, 1[. 
By A'2, either, 

1. for any A e]0, 1[, Xp + (1 - X)q > Xp' + (1 - X)q, or 

2. g>p. Similarly, either 

3. for any A e]0, 1[, Xp' + (1 - A)g > Xp' + (1 - A)g', or 

4. p' > g. 

The only non-trivial case is when both cases | and | occur. But then, we 
have both g > p and p' > g, contradicting p > p'. 

Lemma 12 7/p ~ g, A £ [0, 1], then p ~ Ap + (1 — A)g. 

Proof: Suppose p ~ g > Ap + (1 — A)g. Then, by Lemma [H], 

Ap + (1 - A)g > A[Ap + (1 - A)g] + (1 - A)[Ap + (1 - A)g] = Ap + (1 - A)g, 

a contradiction. Similarly Ap + (1 — A)g > p ~ g leads to a contradiction. 

Lemma 13 Let X e]0, 1[. For any p, g, p ^> Ag + (1 — A)p. 

Proof: Assume p 3> Ag + (1 — A)p. We have p > Ag + (1 — A)p. By 
Lemmas ^ and p > g and Ag + (1 — A)p > g. Since p 2> Ag + (1 — A)p, 
we know that a[Ag + (1 — A)p] + (1 — a)p ~ ag + (1 — a)p, for any a e]0, 1[. 
Therefore, for any such a, aXq + (1 — o?A)p ~ aq + (1 — a)p. By Corol- 
lary ^|, g ~ p, a contradiction. The next lemma does not mention the rela- 
tion 3>, but it does not hold in the wider framework in which negative util- 
ities are allowed: 1 + e ~ 1, but 0.5(1 + e) + 0.5(-l) > 0.5(1) + 0.5(-l). 
Its proof is more intricate than the corresponding proof in the classical 
framework, or any framework in which Independence holds. 

Lemma 14 Let X G [0, 1]. Ifp ~ q, then Xp + (1 - A)r ~ Ag + (1 - A)r. 

Proof: Assume p ~ g. The result is obvious for A equal to one or zero. 
We may assume A G]0, 1[. If r ~ p, then, by Lemma |l2], r ~ Ap + (1 — A)r 
and, since r~g r~ Ag+(1 — A)r, and the result is proved. Assume 
therefore that p ^ r. Without loss of generality, we may assume that 
Ag + (1 — A)r > Ap + (1 — A)r, We shall derive a contradiction. Assume, 
first, that p > r. Since p ~ g we have, g > r and, by Lemma ^, p ~ g > 
ag + (1 — a)r > r, for any a G]0, 1[. Since r ^> p, we have, by A'2, for 
any a e]0, 1[, 

Ap + (1 - X)r > A[ag + (1 - a)r] + (1 - A)r. 

But 

A[ag + (1 - a)r] + (1 - A)r = Aag + (1 - Aa)r = 
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a[Ag + (1 - X)r] + (1 - a)r. 
We see that Xq + (1 - A)r > Ap + (1 - A)r > r. But 

Xp + (1 - A)r > a[Ag + (1 - A)r] + (1 - a)r, 

for any a e]0, 1[, in contradiction with A'3. 

Let us assume now that r > p. By Lemma (?], r > ap + (1 — a)r > 
p ~ g, for any a £]0, 1[. By Lemma 13 r ^> ap+ (1 - a)r, and there- 
fore, by A'2, we have X[ap + (1 — a)r] + (1 — A)r > \q + (1 — A)r, for 
any a e]0, 1[. But we have r > Ag + (1 — A)r > Ap + (1 — A)r and, 

\[ap + (1 - a)r] + (1 - A)r = Xap + (1 - Aa)r = (4) 

a[Ap + (1 - A)r] + (1 - d)r. 

We see that, for any a G]0, 1[, a[Xp+ (1 - X)r] + (1 - a)r > Xq+ (1 - A)r. 
By A" 3, r 2> Ag + (1 — A)r, contradicting Lemma |l3|. Our goal is now 
to show that the relation 3> is a weak order. 

Lemma 15 If p 3> q and q > r, then p>r. 

Proof: If q > r, the result follows from Lemma |^. If q ~ r, let r' be 
such that r > r'. We shall show that, for any A G]0, 1[, Xr + (1 — X)p ~ 
Ar' + (1 - A)p. Indeed, by Lemma |l4[ Ar + (1 - X)p ~ Ag + (1 - A)p, 
and, since q > r' and p>g, Ar' + (1 — A)p ~ Ag + (1 — A)p. 

Lemma 16 7/p > g and g>r, t/ien p>r. 

Proof: Let p > g and g> r. Let r' be such that r > r' . We shall show 
that, for any A e]0, 1[, (1 - X)r + Xp ~ (1 - A)r' + Ap. We know that 
(1 — A)r + Ag ~ (1 — X)r' + Xq. If p ~ g, Lemma [l4] yields the desired 
conclusion. We may therefore assume that p > g > r. We may assume 
p^> r. By Lemma ^, there is some a 6]0, 1[ such that g ~ ap + (1 — a)r. 
Therefore, by Lemma (1 — A)r + Ag ~ (1 — A)r + A[ap + (1 — a)r] — 
(1 — Xa)r + Xap. Similarly, (1 — X)r' + Xq ~ (1 — Aa)r' + Aap. We have 
r > r' and (1 — Aa)r + Aap ~ (1 — Aa)r' + Aap ~. A'2 implies p^> r. 

Lemma 17 The relation ^> is negatively transitive. 

Proof: Assume p ^> g and q~$> r. We shall show that p~$> r. If r > p, 
the result holds. We may therefore assume that p > r. If g > p, g Ji£> r 
implies p ^> r, by Lemma [TJ|. We may therefore assume that p > g. If 
r > ?i P 9 implies p ^> r, by Lemma ns. We may therefore assume that 
g > r. We have p > q > r. 

q~$> r implies there exists some r' , r > r' and some A £]0, 1[, such that 
Ar + (1 - A)g > Ar' + (1 - A)g. By A'2, since g > r, for any a e]0, 1[, we 
have (1 — a)r + aq > (1 — a)r' + ag. 

By A"3, since p j£> g, there is some 7 €]0, 1[ such that g > 7P + (1 — 7)7". 
By Lemma there is some /3 €]0, 1[ such that g ~ /3p + (1 — /3)r. By 
Lemma [wj 

(1 - a)r + a[/3p + (1 - /3)r] > (1 - a)r' + a[/3p + (1 - /3)r] 

and 

a/3p + (1 - a/3)r > a/3p + (1 - a/3)r' 
and we conclude that p j£> r. Let p x g denote that p ^> g and q~$> p. 
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Corollary 4 The relation 2> is a weak order and therefore the relation 
x is an equivalence relation. 

Proof: We notice that 3> is asymmetric, by Al. Lemma |r?| shows that 
it is negatively transitive. 

Lemma 18 Let A C P be an equivalence class of P under x. The re- 
lation > on the set A satisfies Al, A2 and A3. It may therefore be 
represented by a linear functional u : A — > R, the standard set of real 
numbers. If the set P is finitely generated, then, the functional u may be 
taken into the positive real numbers. 

Proof: Since > is a weak order on P, it is a weak order on A C P. For 
any p,q G A, p q, therefore A'2 implies A2 and A'3 and A"3 imply 
A3. By Theorem 4.1 of the relation > on A may be represented 
by a linear functional on A. This functional is uniquely defined up to 
a positive affine transformation. If the set P is finitely generated, by 
Lemma |^, the range of u is bounded and therefore the addition of a large 
enough constant to u ensures its range contains only positive numbers. 

Lemma 19 For any p,q G P, AG [0, 1], one of the following two cases 
obtains: 

• \p + (1 — \)q x p, or 

• Xp + (1 — \)q x q. 

Proof: If A is equal to zero or to one, the result is obvious. As- 
sume A G]0, 1[. If p ~ q, Lemma |l2| implies Xp + (1 — \)q ~ p and there- 
fore Ap + (1 — X)q x p. Without loss of generality, assume p > q. Then, 
by Lemma fj], p > Xp + (1 — X)q and therefore Xp + (1 — X)q ^> p. By 
Lemma p > Xq + (1 - A)p. The proof of Theorem | will now be 
presented. 

Theorem 1 // the set P is finitely generated, then the relation > satisfies 
Al, A'2, A'3 and A"3 iff there is some nonstandard model TZ and some 
linear functional u : P — > TZ+ such that Vp, q G P, p > q iff u(p) y u(q). 

Proof : The if part has been proven in Section |^. Let us deal with the 
only i/part. By Lemma ^ any element of P is x-equivalent to one of the 
generators. Therefore there is a finite number of x-equivalence classes. 
Let them be ordered by 3>: Aq 3> Ai ^> . . . A n -i- Let us choose any 
non-standard model 7£and any e 6 U, positive and infinitesimally close 
to zero. By Lemma |l8|, there are linear functions: Ui : Ai — > R such 
that Vp, q € Ai,p > q iff m (p) > Ui(q). We shall define, for every p G P: 

u{p) = e'ui(p). 

We shall show that, if p > q, then u(p) y u(q). Suppose p > q. If 
p»g, u(p)/u{q) is infinite and u(p) y u(q). If p ^> q, then p x q. Sup- 
pose p, q G Ai. Since ut(p) and Ui(q) are standard numbers such that 
Ui(p) > Ui(q), we have Ui(p) y Ui(q) and e'ut(p) y e l Ui(q). 

We shall show now that, if u(p) >- u(q), thenp > q. Assume u(p) y u(q). 
If p x q, then e l Ui(p) y e l Ui(q) and therefore Ui(p) > Ui(q) and p > q. If 
Pjtq, then there are i < j such that p G Ai and q G Aj and therefore 
p»g and p > q. 
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C Proof of Theorem |2] 

Theorem 2 Assume P is finitely generated and > is a binary relation 
on F. There is a probability measure p on S, a nonstandard model 1Z and 
a linear function u : P — > 1Z+ such that Va, b £ F, 

a > b <^ V\(s)«(a(s)) y y^p(s)w(6(s)) (5) 

ses ses 

iff the relation > satisfies Al, A'2, A'3, A"3, A'4 and A'5. If the 

relation > on P is not trivial, the probability measure p is unique. 

Proof: Let us prove first the only if part. Assume Equation |E| holds. We 
notice that F is a mixture set and that, by letting u'(a) d = ^2 s( z S p(s)u(a(s)), 
we have 

a > b <4> u'(a) y u'(b). 

By the results of Section |[ Al, A'2, A'3, and A" 3 hold. 

Let us check that A'4 holds. Assume that a(s) = b(s) for any s £ S, 
s / so and that a > b. If 

^p(s)M(o(s)) y ^p(s)u(6(s)), 

ses ses 

then, by Lemma B, part |l2[ p(so)u(a(so)) >- p(so)ii(o(so)). By part || 
we have u(a(so)) y u(b(so)). But X^ses P( s ) u ( a ( s o)) = u(a(so)) and simi- 
larly X^es p ( s ) M ( & ( s °)) = u(b(s )). Therefore J] s6S P(s)«(a(-5o)) >- S seS p(s)w(6(so)) 
and a(so) > b(s ). 

Let us check now that A'5 holds. By Lemma [j], a(t) S> a implies 
that either u(a(t))/u(a) is infinite, or a(t) > a and a < b for any o £ F. 
Since u(a) > p(t)u(a(t)), if u(a(t))/u(a) is infinite, p(t) must be equal 
to zero and t is null. If a(t) > a and a < b for any b £ F, then, letting 
x — ~^2 s£S p(s)u(a(s)), we have x -< u(a(s)) for any s £ S. By Lemma |6|, 
x u(a(t)) implies that p(t) = 0, and t is null. 

Let us deal now with the more challenging if part. Assume Al, A'2, 
A'3, A" 3, A'4 and A'5 are satisfied. By Theorem [j] since Al, A'2, 
A'3 and A" 3 hold, there is a nonstandard model 1Z and a linear function 
u* : F — > TZ+ such that Va, b £ F, 

a> b^> it* (a) >- u*{b). (6) 

Since P is finitely generated, by Lemma [?], there are minimal (I) and 
maximal (h) elements of P. Both / and h are constant functions in F. 
By Lemma H, for any a £ F, i ^ a X ft. If £ ~ /i, all acts are equivalent 
and the Theorem is easily proved. Suppose, therefore, that h y I. By 
Lemma ||, parts |^ and |l^, 

a > tt-t: > ttt\ • 

u*(n) u*\h) 

This means we may assume, from now on, that u*(l) — and u*(h) — 1. 
For t £ S, let us define c t £ F by c±(t) = h and, for s ^t, c t (s) = I. If 
t is not null, by A'5, h~^> Ct and, by A"3 and Lemma hd there is some 



19 



A £ [0, 1] such that c t ~ Xh + (1 — A)Z; in this case we shall define p(t) = A 
and notice that u*(ct) ~ ?>(£)■ If Z is null we take p(£) = 0. In this case, 
notice that ct ~ Z and therefore lt*(c<) = 0. 

Clearly, for any s G S, < p(s) < 1. We claim that, for any a £ F, 



Notice that we do not claim equality, only similarity, i.e., ~, between the 
left hand side and the right hand side. Let us justify our claim now. Let 
a £ F and c = X/ses M *( a ( s )l^ If c = 0, then, for any s 6 S, u*(a(sY) = 
and a(s) ~ Z, and by Lemma ^| a ~ Z, u*(a) = 0, by Lemma ^, part gand 
the result holds. If c > 0, let 

i def ^ U *( a ( S )) 

Cs - 



sSS 

Let us, first, compare a and b. For any t 6 S, 

ft(*) = M * ( ° (t) W(i- M * ( f V 

We see that, for any t £ S, 

1 



it 



(6(t)) = -«>(*)). (7) 



Let us assume, first, that c < 1. Define the act a' by: 

/ def . / ^ , . 

a = c o + (1 — c) Z. 

For any s £ S, a (s) = c6(s) + (1 — c)Z, u*(a (s)) = cw*(6(s)) and there- 
fore u*(a'(s)) = u*(o(s)). We conclude, by Lemma 0, that a' ~ a, and 
therefore «*(a) ~ u*(a'). But, by linearity of u* , u[a') = cu*(b). We 
conclude that u*(a) ~ c u*(b). The case c > 1 is treated similarly by defin- 
ing 

b' d = (l/c)a + (l-l/c)Z. 
But, now, by linearity of u*, 

u*(b) — - y^it*(a(s)) M*(c s ). 

Therefore 

u*(a) ~ y^u*(o(s)) u*(c s ). 

ses 

We have seen that u*(c s ) ~ p(s) when p(s) > and u*(c s ) — p(s) when 
p(s) = 0. Therefore 



ses 

as claimed. The first conclusion we draw is that: 

a > b <^> V^p(s) w*(a(s)) >- Y^p(s) u*(b(s)). 



ses ses 
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Our second conclusion is that 1 = u*(h) ~ Xsgs P( s ) u *(h) = S s gsP( s )' 
Therefore ^2 aSS p( s ) ~ 1- But, for any s £ S, p(s) is standard. It follows 

that E ses p( s ) = L 

For the uniqueness claim, notice that X/ S gs P( s ) u ( c <( s )) = P{t) u {h) + (1 — Piff) u if)- 
By Equation^, then, ct ~ p(t)h + (1 — p(t))l. By Corollary |§| there is only 
one such p(t). 
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